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INTRODUCTION 


Today’s competency-based education (CBE) pro- 
grams are offering students a unique postsecondary 
experience that focuses more on student learning and 
less on whether or how long a student has spent time 
in a classroom. The approach has been lauded by 
public officials as “a promising new delivery model” 
(Mitchell, 2015) and as having “the potential to trans- 
form education” (Laine, Nielson, Cohen, & Palmer, 
2015). This approach is also seen as a disruption to 
higher education as we know it (Weise & Christensen, 
2014; Soares, 2012). These programs focus on compe- 
tencies rather than credit hours, require students to 
demonstrate those competencies through authentic 
assessments, recognize extra-institutional learning, 
and often expand faculty roles to include activities 
such as individual coaching. 

All of these changes—and many others that are 
necessary when implementing a new CBE program— 
can be challenging for institutions to manage. But 
they can be made even more challenging in the 
absence of support from faculty. For this reason, 
many institutions make it a priority to educate and 
engage faculty early in the process of designing and 
developing CBE programs. Over the past two years, 


©The Council for Adult & Experiential Learning, 2016 


the Council for Adult and Experiential Learning 
(CAEL) has been assisting institutions in this effort 
through its Lumina Foundation-funded CBE Jumpstart 
initiative, which provides CBE training workshops 
designed to educate faculty and staff about CBE and 
help them engage with CBE design considerations. 

This report shares details about the impact of 
these workshops on the depth faculty and staff have 
in understanding CBE, as well as the degree to which 
these workshops may have helped to encourage 
institutions to move forward with CBE. In particular, 
interviews with trainees at participating institutions 
revealed that training on CBE can be valuable at very 
different stages of institutional engagement; that 
institutions benefit the most from learning about the 
various kinds of CBE models that are possible, and 
that training can sometimes play an important role 
in spurring institutional leadership and staff towards 
implementation. 

While this study was conducted only on the 
CAEL-provided CBE training, the lessons from the 
self-study may be helpful to the entire field for 
understanding what institutions find most useful in 
the early stages of CBE planning and development. 
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BACKGROUND 


Competency-based education (CBE) is a term used 
for programs that focus more on what students have 
learned, rather than where or how long the learning 
takes place. Instead of evaluating student progress 
primarily on the amount of time spent in a classroom 
(using the credit hour, which is the default standard 
for measuring progress), students engage in learn- 
ing activities and then progress towards a degree or 
credential by successfully demonstrating their skills 
and competencies through specially designed assess- 
ments. Some CBE programs have been designed to 
allow students to learn and progress at their own 
pace; some are leveraging technology in new ways 
to facilitate student-directed learning as well as cost 
savings for the student and ostensibly also for the 
institution. In addition to these benefits, many insti- 
tutions are choosing to offer CBE programs as a way 
to improve the quality of higher education by focus- 
ing on evidence of student learning outcomes rather 
than seat time. 


Design Considerations 


Institutions interested in developing CBE programs 
face a number of design considerations as outlined 
in a new Public Agenda publication (see next page). 


Key design questions include: 


e What competencies must students demon- 
strate, and how do we define these 
competencies? 


e How will students learn in order to success- 
fully demonstrate the competencies? 


e What student support services are needed 
for students to be successful? 


How will the program assess for these compe- 
tencies in a valid and reliable way? 


How will the competency framework map back 
to the credit hour for the purposes of a student 
transcript, student transfer, faculty workload, 
or financial aid? 


How will the institution support student learn- 
ing through technology and manage internal 
business processes for a program based on com- 
petencies, rather than courses or credit hours? 


e What are the roles and responsibilities of fac- 
ulty in this new CBE program? 


A Different Role for Faculty 


The more traditional role for faculty in higher 
education is as instructor—in the past, this has 
typically meant that faculty are the “sage on the 
stage,” lecturing to students to impart knowledge. 
In recent years, this model has been challenged in 
some institutions, with faculty experimenting with 
more active learning pedagogies or engaging with 
students as mentors (Hainline et al., 2010). 

The format of many CBE programs is formalizing 
this kind of dramatic change in the faculty role. 
Faculty may have one or more of the following 
roles: 1) developing the curriculum, 2) designing 
and grading assessments, 3) providing support to 
asynchronous instruction, and 4) coaching/advising/ 
mentoring (Cleary, 2015). 


What is the impact of these changes in the roles of 
faculty on student learning? Researchers will surely 
be examining this important question as more of 
these programs emerge and as more students engage 
with them. However, past research suggests that the 
transformed faculty roles could have a distinct ben- 
efit for students. There is literature showing that 
student-faculty interaction notably contributes to 
student success, and that regular faculty mentoring 
and tutorial-style interactions are associated with 
greater student learning (Kezar & Maxey, 2014). 
By providing a formal structure for these kinds of 
regular student-faculty interactions, rather than 
assuming that they will happen spontaneously in a 
course-based format, CBE programs could be institu- 
tionalizing a critical student success factor. 


Change Management 


The change in faculty roles is just one of the 
major issues institutions need to consider for a pos- 
sible move towards CBE. There are a lot of changes 
that institutions need to plan for while involving a 
number of different stakeholders: not just faculty 
and leadership but also registrars, IT staff, advi- 
sors, financial aid experts, marketing departments, 
and so on. 


2016 CAEL Faculty and Staff Views of CBE 


CBE SHARED 


DESIGN ELEMENTS 


Clear, cross-cutting, and specialized 
competencies 

Coherent, competency-driven program 
and curriculum design 

Embedded process for continuous 
improvement 

Enabling and aligned business processes 
and systems 

Engaged faculty and external partners 
Flexible staffing roles and structures 
Learner centered 

Measurable and 

meaningful assessments 

New or adjusted financial models 
Proficient and prepared graduates 
(Public Agenda, 2015) 


CAEL knows from our work with institutions on 
implementing prior learning assessment (PLA) pro- 
grams that certain shifts within higher education 
are significant enough—and may feel threatening 
enough to certain constituencies—that change needs 
to be managed in a deliberate way. For example, a 
lesson from our PLA experience is that educating key 
stakeholders is a critical first step towards making 
big evolutions possible. It is important to make sure 
that institutional leadership, faculty, and key staff 
all have the same background information, the same 
working definitions, the same knowledge about the 
pedagogy or theoretical underpinnings of a new pro- 
gram or approach. And it is critically important that 
inaccurate information is corrected and that any 
negative views are acknowledged, discussed, and 
worked through openly. CAEL, therefore, has dedi- 
cated a lot of our PLA work to educating the field on 
what PLA is, what it is not, and what pieces need to 
be in place for an institution to do PLA well. A key 
audience for this kind of educational effort is fac- 
ulty, as they are not only the subject matter experts 
but also often the guardians of academic integrity 
within the institution. It is critical to have them fully 
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engaged with new ideas in order to ensure successful 
implementation of change. 

With something like CBE, CAEL believed that 
providing education to key faculty and staff early 
on in an institution’s exploration of CBE could also 
be important in helping to expand institutional 
knowledge and potentially fostering greater enthu- 
siasm and momentum for design, development, and 
implementation of new CBE programs. Therefore, 
over the past few years, and with support from 
Lumina Foundation, CAEL has provided 18 postsec- 
ondary institutions and 3 postsecondary systems 
with one-day, on-site, CBE introductory workshops 
that we call CBE Jumpstart. ' 

The CBE Jumpstart training was offered to 
the participating institutions and systems in both 
web-based and face-to-face formats to groups of 
faculty and administrators. Each workshop was 
offered to a single institution or system so that 
the group discussions could focus exclusively on 
how CBE could work in that particular setting. The 
training covered: 


What competencies are 


How competencies communicate a stu- 
dent’s progress toward a degree 


What CBE looks like in practice at various 
institutions 


What good practices in using assessment in 
CBE programs are 


What the various assessment tools and 
approaches are 


How faculty roles would change 


How to incorporate PLA into a CBE program 


How to incorporate CBE and/or competen- 
cy-based assessment (CBA) into a PLA program 


How to develop a CBE program that is com- 
patible with the institution’s mission 


These trainings were offered between June 2014 
and November 2015. 


1 The Jumpstart institutions and systems were select- 
ed through a competitive process. See Acknowledgments 
for list of participating institutions and systems. 
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LESSONS FROM THE TRAINEES: 


The Jumpstart workshop training had three main 
objectives: 


e To educate faculty and staff about what CBE is 


e To educate faculty and staff about the 
potential benefits of a CBE approach in 
higher education 


e To address concerns about CBE with the 
hope that doing so in an open way could 
help to encourage greater acceptance of—if 
not enthusiasm for—CBE 


Pre- and post-tests were used to capture the 

immediate reaction of the 463 trainees. Overall, 
the greatest change from pre- to post-test was in 
the area of general knowledge about CBE. And while 
there were many trainees who also saw improve- 
ments in their views of the value of CBE and their 
personal opinions about CBE, the ratings suggest 
that the impact of the training in these areas was 
not as widespread when compared to the perceived 
gains in content knowledge. (See Appendix A for 
additional details on the pre- and post-tests.) 
In follow up interviews with 22 trainees (including 
some of the lead CBE staff) from 13 of the Jumpstart 
institutions and 2 of the participating systems con- 
ducted in December 2015 and January 2016 were 
more revealing than simple pre/post-test measure- 
ments, providing insights about: 


e Timing and Purpose: The value that the 
training had, if any, for the institution at its 
particular stage of early CBE engagement 


Training Content: The specific parts of the 
CBE training that were particularly valuable, 
and other sources of information about CBE 
that have been valuable to the institution 


e Current views about CBE: Positive views 
as well as lingering concerns about CBE 

e Moving Forward with CBE after 
Training: The degree to which the 
training was helpful in sparking greater 


TIMING, CONTENT, VIEWS OF CBE, 
AND MOVING FORWARD 


enthusiasm for CBE and/or progress towards 
implementation 


Timing and Purpose of the Training 

The Jumpstart training was designed for institu- 
tions in the early stages of planning a CBE program, 
yet the range of engagement with CBE varied widely 
among the various institutions. Nevertheless, regard- 
less of what kind of “early stage” the institution was 
in, the CBE training served a purpose. 

Some participating institutions and systems were 
very early in the process, with a small number of fac- 
ulty or staff having done some preliminary research 
or having attended national CBE events or work- 
shops. One trainee explained that the training was 
useful for his institution early in the process because 
he wanted to figure out if CBE was a real thing that 
the institution should be pursuing or if it was just a 
fad or a trend. He said, “There are so many trends in 
higher education that come and go. It was important 
to understand what this is. It takes a major com- 
mitment to move from a traditional approach to a 
competency-based approach. No one wants to do it 
unless there’s a level of certainty that it’s viable.” 
Another trainee, who considered himself somewhat 
of a CBE champion at his institution, wanted the 
training to be a way to introduce CBE to a wider 
group of faculty and staff. He ultimately found that 
the training helped “tremendously” by honing the 
institution’s focus. He said that the CBE training 
“helped bring people together... It raised objections 
so we understand how to address problems. It helped 
us engage with employers. Just knowing it’s a grow- 
ing movement allowed people to consider something 
they might have dismissed.” 

Systems leaders similarly wanted the training to 
help get more conversations started at and across 
individual institutions. One system representative 
said that the focal point of their participation 
was to “convince institutions to get on board.” 
Another concurred, saying that the training was 
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“an opportunity for us to say to the colleges ‘hey, 
we have technical assistance, you guys are into it, 
let’s come together and have a single conversation.’ 
[The training] allowed me to have a platform to have 
this discussion for all of the colleges—get them all 
engaged in the process, and be more intentional 
about moving programs in that direction.” 

Some institutions had some kind of CBE task force 
already established and had done some research 
and preliminary planning as a group. For them, the 
Jumpstart training had two purposes. First, the training 
helped the core group to get on the same page in terms 
of content knowledge. One trainee explained that 
having individuals attend various national meetings 
and training was like “sending out scouting parties”; 
having the entire core group be part of a single training 
session gave them a stronger foundation from which to 
move forward. Second, the training allowed the core 
group to expand its circle and include other parts of 
the institution. After the training, “student services 
folks got it.” This meant, in some cases, that some 
of the trainees knew very little—or that they came to 
the training with a lot of skepticism. One trainee said 
that such a situation could have been a disaster if the 
skeptical ones had just dismissed CBE outright, but 
that didn’t always happen: “[The trainer] presented 
the [emerging] practices and this really opened the 
conversation. [Some were] skeptical, but they asked 
the hard questions. They were willing to explore it to 
the depths. It was a successful effort to show models, 
get conversations going, and answer questions.” 

Some institutions not only had key stakeholders 
engaged but also a design well underway. These 
institutions similarly used the training to expand the 
knowledge base at the institution as a way to build 
internal awareness while, as one trainee explained, 
also “providing external validation and support 
around the team’s own ongoing development pro- 
cess.” Another institution that was further along in 
the planning process acknowledged that they came 
to the training with a lot of existing knowledge about 
CBE but still learning and wanting to have more dia- 
logue about “the gray areas.” A trainee from that 
institution said that the Jumpstart training “allowed 
for that dialogue, and allowed for more folks around 
the institution to be part of that conversation.” 
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Training Content 


Trainees offered a lot of feedback on the content 
of the training, noting which parts of the training they 
found most valuable, such as how CBE may already be 
implemented within their institution, giving credence 
to its value; CBE’s correlation to PLA; and, particularly, 
learning about the range of CBE models. 


Value in Learning about Other Models 


Interviewed trainees mentioned almost in one voice 
that one of the most important parts of the train- 
ing was learning about the different CBE models that 
were already being implemented by various institu- 
tions. Many individuals came to the training with a 
preconceived idea about what CBE is, and they were 
excited to learn that CBE can be implemented in many 
different ways, depending upon the discipline, the 
institutional mission, the make-up and characteristics 
of the student body, available resources, the internal 
appetite for radical transformation of instructional 
delivery, and so on. Explained one trainee: 


We’ve seen the variety of models and feel 
like we don’t have to leap to the most aggressive 
form first. We can build it to scale it up over 
time....We really liked looking at other models. 
It helped us know that we can be creative, still 
get accredited, and accomplish the goal. 


Other participating institutions were likewise 
relieved that they could think beyond some of the 
archetypal CBE models that have adopted online, 
self-paced, Direct Assessment approaches. One 
trainee said that by showcasing various ways to do 
CBE, the training helped them evolve; “Now we see 
the potential for lots of approaches for CBE...CBE 
doesn’t have to be one way.” Another trainee men- 
tioned that people at her institution assumed that 
CBE meant doing it the way one large national institu- 
tion does it. “That’s not who we are,” she explained, 
“We want to offer a lot of different ways a student 
can participate in learning experiences, and demon- 
strate their learning in unique ways.” 

Exposure to different models and approaches 
helped to introduce new concepts to some of the train- 
ees—for example, subscription-based tuition models or 
various ways to convert credit hours to competencies. 
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One institution was able to see in a new way how it 
might use CBE differently for the technology-based 
parts of its program, compared to the non-technology 
parts. He said, “[The trainer], showed us examples of 
models and we started to look at things that happen 
in the classroom where we might shift the examples 
and replace tech aspects of the work that’s evalu- 
ated.” This demonstration helped them see how they 
might modify how they assess for some of the more 
technical competencies. 

Exploring different models is also useful for con- 
verting some skeptics. If they only know of CBE as 
something offered by Western Governors University 
or College for America or Capella, they might find 
it easy to dismiss CBE as something that is offered 
primarily by non-traditional or for-profit institutions. 
Said one trainee, “When we started seeing University 
of Wisconsin... Penn State, schools that are more like 
us, doing CBE, we started to see things more clearly. It 
created more relevance—it could be something that’s 
done here at our university.” Another said that some 
faculty came out of the Jumpstart training saying, 
“Hey, | didn’t understand how many schools were into 
this!” Many are following up with these institutions 
to explore their models further. Said one trainee, “I 
wanted to connect with traditional universities that 
are making a transition—like us—and tap into what 
they’ve learned.” 

Learning from others eventually goes both ways. 
A representative from one of the institutions that 
has since moved forward to implementation said, 
“Now, people are asking us questions—and we are 
getting calls!” 


PLA as a Pathway to CBE 

Some institutions found that learning about how 
CBE relates to other higher education initiatives, 
such as PLA, is also very useful and provides a per- 
spective that is not often covered in available CBE 
literature. This feedback from the interviewed 
trainees is not entirely unexpected, given that the 
competitive process for selecting the Jumpstart 
institutions/systems included as one criteria the 
institution’s history with PLA, and that the CAEL- 
developed training has a strong focus on PLA as a 
kind of “sister innovation” to CBE. 


In CAEL’s view, there is a close relationship 
between CBE and PLA: 


e They share a common underlying philoso- 
phy that higher education needs to value 
and reward what a student knows and is 
able to do 


Best practice for both assumes learning 
assessment that measures student learning 
against pre-determined criteria and not by a 
subjective process 


e PLA and CBE have operational compatibility with 
each other; many CBE programs include PLA as 
a way for students to demonstrate competencies 


CAEL has proposed that CBE and PLA exist on a 
continuum, with PLA providing a way to integrate a 
competency-based approach into more traditional 
course-based programs, or to be a kind of stepping 
stone to a fully competency-based curriculum and 
degree program (Tate & Klein-Collins, 2015). /t is 
important to keep in mind, however, that while 
both CBE and PLA introduce challenges under Title 
IV, CBE programs’ teaching and instructional com- 
ponents allow a clearer path to federal financial 
aid eligibility; most fees associated with PLA as 
assessments of learning are currently not eligible 
for federal financial aid. 

One system representative, who was a trainee, 
said that understanding the relationship between 
PLA and CBE contributed to her feeling more posi- 
tively about CBE. She had already been working with 
institutions within her system to feel more comfort- 
able with the idea of students earning credit for 
learning outside of a rigid course format. Because 
they had already had conversations around PLA, the 
institutions were primed to be receptive to this idea 
because of the strong emphasis on assessment of 
learning. Said the trainee, “PLA has opened a lot 
of conversations. It can be a gentler door to come 
through than CBE.” Similarly, another trainee noted 
that his institution’s history with PLA created a start- 
ing point. He said, “CBE to me has been the next step 
of PLA. They are related to each other. You can’t do 
CBE if you don’t have some form of PLA.” 
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Revelations about Own Institution 

Trainees also referenced how the Jumpstart 
training helped them better understand their own 
institution’s history with CBE. One trainee mentioned 
how the institution’s social work program had incorpo- 
rated aspects of CBE, and another trainee noted that 
the institution’s nursing program was centered around 
competencies. The training gave the participants the 
opportunity to understand how CBE was already being 
implemented in some way and how CBE might not 
necessarily be entirely new and radical. 

One trainee recalled how faculty from the insti- 
tution’s aviation program came out of the training 
saying, “Hey, the FAA already does this, didn’t you 
know that? The FAA has been doing this for a long 
time, and they believe in it and practice it.” However, 
this revelation was accompanied by the recognition 
that, in the same program, mechanics in training are 
required to have 1800 hours working on an engine or 
pieces of an airplane in order to be certified. Trainees 
began to make important connections to their own 
programs—which ones are competency-based and 
which are frustratingly not. The trainee from the 
institution with the flight program said, “We discov- 
ered a lot of things like that—competency programs 
are here at our university, but we wished competen- 
cies were across the board.” 


Current Views about CBE 

Enthusiasm for the Promise of CBE 
In the follow up conversations with trainees, there 
was much that stood out for them as the positive 
aspects of CBE: 


¢ CBE is a good fit for adult students. One 
trainee said that CBE gives adult learners “the 
maximum ability to take advantage of what 
they’ve learned in their lives.” Others again 
made the connection between CBE and PLA 
and how students with prior knowledge can 
come to a CBE program and progress much 
faster. One trainee explained, “I really like 
that it’s learner centered, it’s so much about 
the student and what they know and what 
they bring to the table. It can focus on what 
they don’t know, and it’s less about knowledge 
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acquisition. Traditional students cram, dump it 
on a test, and then forget it. Here, they show 
competency and this addresses learning.” 


CBE gives students a way to talk to 
employers. CBE helps students understand 
what is relevant in the workplace; as one 
trainee explained, “It helps students have 
a voice to say, ‘Here are the specific things 
I’ve learned,’...it helps them to look for jobs, 
helps them know how to talk to employers.”.” 
Another noted how students who are current- 
ly employed can “apply their learning to their 
jobs” and the curriculum can be customized 
to their own workplace circumstances. 


CBE gives institutions a way to work 
with employers. One trainee said that CBE 
is giving her institution a way to engage em- 
ployers differently, showing how the program 
is a response to a company’s workforce devel- 
opment needs and that it can work easily with 
the employee tuition benefit. 


CBE can provide consistency in assess- 
ing student learning. A trainee observed 
that in traditional higher education, there 
might be three different instructors teaching 
the same class with different assessment meth- 
ods, wildly different results in terms of student 
learning, and no real way to standardize. In 
that trainee’s view, CBE solves that challenge. 


CBE is self-paced. Said one trainee, “You 
can’t herd people together at the same time; 
they have different needs. You need to allow 
adults to master the competencies at their own 
pace. This is something we need to get into.” 


CBE is about learning and mastery, 
not time spent. “| have never liked the 
Carnegie model. Just because you have your 
rear in a seat for a long time, you are com- 
petent in a subject? | like that CBE turns the 
whole notion on its ear. You are not just put- 
ting your time in, you are proving your mas- 
tery of a subject.” 
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¢ CBE provides a framework and a rea- 
son for faculty to collaborate. This item in 
particular was appealing to system representa- 
tives. One shared that the purposeful approach 
to defining learning objectives has value within 
the institution. “Being able to get faculty to- 
gether to identify learning outcomes and ob- 
jectives...l’ve been seeking ways to get faculty 
across disciplines and institutions to come to- 
gether and think more concretely about learn- 
ing objectives and how we learn and measure 
them. | see a lot of intrinsic value in that.” 


Lingering Concerns about the Challenges 

Despite the many promises of CBE, and the strong 
positive opinions that most of the trainees expressed, 
many admitted to having some lingering concerns 
about CBE. One set of concerns had to do with the 
sense that there was persistent faculty nervous- 
ness about (though not necessarily outright hostility 
toward) CBE. Some faculty apprehensions focused on 
whether there is enough proof that CBE would live up 
to its promise and others had to do with the changing 
faculty role. A second set of concerns had to do with 
student interest and engagement. A third category of 
uneasiness—and the most commonly mentioned by the 
trainees—had to do with the recognition that devel- 
oping and implementing CBE would be a monumental 
endeavor and questions about whether the institution 
had the resources, in terms of both time and exper- 
tise, to succeed. 


e« General faculty skepticism. Recent early 
adopters of CBE have shared that one of the 
biggest obstacles to CBE may be general faculty 
resistance to it. While the Jumpstart training 
was designed to help address that resistance 
through education, the training may not have 
always been attended by the exact faculty or 
staff who most needed it, whether because of 
space limitations or because of imperfect in- 
formation about where the biggest resistance 
would come from. Several trainees noted that 
this kind of resistance was still there—one 
thought that resistance was mostly confined 
to general education and humanities faculty 
(“Information technology has been great!”). 
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Some resistance is not because of wholesale 
objections to CBE but rather because of spe- 
cific questions, such as whether the institution 
isn’t already doing something like this by focus- 
ing on learning outcomes, or whether there is 
enough data yet to draw firm conclusions about 
CBE in terms of student success. One trainee 
expressed concern that while CBE in theory is 
something that could address quality in higher 
education, in practice, there’s a lot of potential 
for it to be implemented badly. He said that 
there needs to be much stronger guidance in 
terms of best practices so that it won’t be “di- 
luted into something that isn’t valid.” 

Another quality-related concern was wheth- 
er the online, self-paced CBE program model 
would suffer from the lack of student-to-stu- 
dent interactions at an institution where en- 
rollments were not large. He said, “How in 
the world are we going to recreate the sort of 
learning that happens when students engage 
repeatedly in small groups? If you’re at the 
scale of WGU, you can just call on students to 
work in small groups. Not with us. At our scale, 
you can’t count on that, you can’t figure out 
how it would be viable.” 

Faculty resistance is also related to the 
change in faculty role from an instructor 
in a course-based system to a coach/asses- 
sor/designer in a CBE program. Even after 
Jumpstart training and after additional con- 
versations with CBE pioneering institutions, 
some faculty are not as on board as are the 
deans and others on the administration side. 
One trainee said, “On the faculty side, there 
was pure fear; they wondered, ‘How can | 
do this, how can | teach students?’” Another 
trainee reported that faculty are no different 
than anyone else—they are uncomfortable 
with any change, but particularly one that 
redefines their jobs in such a significant way. 
A trainee said, “Some people were comfort- 
able with CBE, some had reservations. | had 
the impression that people left [the training] 
feeling they had their questions answered. 
There was generally a positive reaction, and 
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I’m optimistic. But, academics are involved, 
and it’s so challenging to persuade them to do 
anything differently. CBE changes the faculty 
role and that can be threatening.” 


Concerns about student interest and en- 
gagement. Some trainees expressed appre- 
hension that CBE might not be a good fit for 
many students. One shared a story about some- 
one he knew in a CBE program who was thriving 
but also knew about many other students who 
gradually dropped out of the program. “When 
you’re doing stuff online, it seems like it’ll be 
easier,” he said, “but it’s more work. It’s hard. 
You have to be motivated.” Another trainee 
added, “We’d do someone a real disservice if 
we signed someone up for CBE and they’re not 
the kind of learner who could maximize the 
benefits of CBE.” 

Some trainees had worries about whether 
there would be enough demand from students 
to make it worth the effort of building a CBE 
program. Said one trainee, “I’m still very pos- 
itive, but apprehensive in terms of being sure 
of scale, how many students we can attract, 
and what does success really look like for stu- 
dents....I’d like to hear from other institutions. 
It’s still very grey.” 


Concerns about implementation. Just 
about every trainee raised questions related 
to how the CBE program would be implement- 
ed. There were anxieties about expertise 
around learning outcomes and competencies; 
one system trainee said that she thought the 
Jumpstart training was a nice introduction, 
but afterwards felt like the institutions in her 
system needed additional in-depth training 
in how to write competencies and learning 
outcomes. 

Several institutions voiced uncertainty about 
how to build the program in terms of infrastruc- 
ture needs like the learning management system 
(LMS), the student information system (SIS), 
and other day to day operational needs. On the 
one hand, trainees bemoaned the fact that off- 
the-shelf data management solutions did not 
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yet exist, and on the other hand, they were 
fearful that once those systems did emerge in 
the marketplace, they might not be affordable. 
Other trainees noted how much work would be 
required to involve registrars, student services, 
and other important institutional functions. 
The heavy lifting involved to make financial aid 
work within the CBE framework is enough, said 
one trainee, to “make your brain hurt.” 
Several trainees were disquieted by wheth- 
er the institution had the financial resources to 
make CBE a reality or not. Said one, “We ac- 
tually had 100% buy-in from faculty. The prob- 
lem: resources. Who has the time? How can 
you fund the development? Is [time spent on 
development] all voluntary? Are you kidding?” 
The trainees wondered how to support more 
training for faculty, how to compensate faculty 
in the program, how to charge students. “These 
are the things that are keeping me awake at 
night,” said one trainee, “We got a little tech- 
nical assistance, but we need a lot more.” 


Financial questions are also at the forefront 
when thinking about the long-term sustainabil- 
ity of a CBE program. Hearing other CBE pio- 
neers talk about their financial models has not 
been encouraging; one trainee heard a repre- 
sentative of an existing CBE program say that 
the CBE program is not a way to make money, 
leading faculty to wonder, “What’s the finan- 
cial model and why would we do it if there is 
no benefit to us financially?” 


Moving Forward: Idling in 
Place or Full Steam Ahead? 


The CBE Jumpstart training was designed to edu- 
cate institutional faculty and staff on various models 
and design needs of CBE programs. In the process, it 
is possible that the training divulged how developing 
and implementing CBE might be more challenging an 
undertaking than may have been understood previ- 
ously. Yet, the overall reaction to the training was 
positive, and many of the institutions involved in the 
initiative are moving forward in the planning and 
development process. 
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In our interviews, we asked whether the training 
had a role in fostering enthusiasm for CBE. Only two of 
the 22 interviewees said no—one because his faculty 
and staff were already far along in their thinking and 
were highly supportive of CBE already; and the other 
because of intense faculty resistance and a governing 
board that had decided to block any movement on CBE. 
The remaining interviewees had a lot to say about the 
enthusiasm generated by the training: 


“Sure, | think, in particular, a couple of 
people—and even in surprising areas such as 
philosophy. He came out like, ‘Wow, what an 
interesting way to think of things!’” 


“It was hard to know what we needed to know. 
We didn’t have much confidence in our knowledge 
base. The training was a booster for us. [It] was 
affirming that our thinking was solid, far along, 
well aligned, where we need to be, ‘atta boy, go 
get ‘em tiger!’ That was our big takeaway—that 
our foundation was strong, we were on the right 
track, and that we have what it takes to move 
forward.” 


“It’s the kind of thing that...generates a little 
bit of momentum. We were all ready to take the 
next step after the training....People were inter- 
ested in learning more because we had questions: 
how you determine programs, how to navigate 
a system change, financial aid—those were the 
questions we had after the [training].” 


“The training allowed us to use that info to 
get into the nuts and bolts of systems/depart- 
ments of organizations, how we’d all work 
together. What | appreciated most—we broke 
into small groups, and allowed groups to do the 
investigation. We all walked away excited about 
the opportunities. We left excited! This is huge, 
this is big, this is different!” 


Months after the training, there is a range of prog- 
ress that has been made. A full report describing the 
efforts of individual institutions will be prepared later 
in 2016, but among the sample of trainees from 13 
institutions and 2 systems, one CBE program is up and 
running with students enrolled, another was to launch 
in January 2016, and a third will be launching by the 
end of the calendar year. One of the institutions was 
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piloting individual competency-based courses while 
developing internal policies to develop more CBE 
programs in the near future. Five more institutions 
were deep in the planning stages, and two more had 
reached the point of having fleshed out proposals for 
their programs. 

Those institutions that were able to move forward 
seemed to have the right people in place, supportive 
administrations, and a real desire to move forward. 
Some of it may have to do with institution-specific fac- 
tors; one of the implementers acknowledged, “Mostly 
people at [my institution] are used to moving quickly 
on program development. We are different than other 
institutions on how quickly we move on programs.” 
Yet the training was still seen as key to getting things 
going. Said one trainee from one of the implementing 
institutions, “The training was at a time where we were 
dipping our toes in, do we want to pursue this?” His 
colleague added, “If we hadn’t had [the trainer] come 
and do the presentation, we wouldn’t have gotten this 
far so fast.” 

Institutions that have not seen progress are, for the 
most part, not saying that they admit defeat. Rather, 
the training fostered interest, but the momentum didn’t 
propel things forward at a rapid pace. Several trainees 
said the training was a good way to start the conversa- 
tion, and one added that the people who attended the 
training are now seen as the innovators who want to do 
something. “So we’re poking at the interest...[saying, ] 
‘It sounds like you have the background to start the 
ball rolling. You’ ll be the innovators on your campus.’” 

There are trainee voices that seem discouraged 
about the chances for CBE implementation. A few noted 
that while the training was helpful for getting the con- 
versation going, there was no momentum that followed. 
One trainee acknowledged that she and her colleagues 
are set in their ways. She explained, “It’s so easy to get 
up and lecture three days per week, use the text book 
and quizzes, and assess the student based on the tests 
and quizzes. All you have to do is lecture and make 
sure grading is done. That’s the norm of teaching. It’s 
hard to move that norm. Competency-based education 
upsets that.” Finally, nothing can happen when institu- 
tional finances are limited. One trainee said that they 
have the desire and the excitement, but no resources 
for innovation anymore due to severely restricted state 
funding. “For us,” she said, “it’s frustrating.” 
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CONCLUSION 


CAEL’s Jumpstart training was designed to sup- 
port institutions wanting to move forward on CBE. 
It provided a day-long workshop with basic infor- 
mation about CBE, important design considerations, 
various models that institutions might consider, and 
information about potential challenges that will 
need to be addressed. 

The feedback from the trainees can help to inform 
other types of CBE education efforts happening else- 
where in higher education. In particular, we learned 
that the training helped to start important conversa- 
tions within institutions; it helped “level set” the CBE 
knowledge of key stakeholders needed for planning 
and implementation; and, at several institutions, 
it fostered internal enthusiasm and excitement for 
CBE—enough to get programs launched or moving 
forward towards implementation. 

The training was not, however, the silver bullet 
for every program—nor should it be! Training can 
provide valuable information and can even change 
minds and perspectives, but it is hardly fool proof 
and not likely to be able to address entrenched 
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faculty resistance to change or financial limitations 
that are well beyond an institution’s control. 

In some cases, the training introduced the train- 
ees to implementation challenges that they might 
otherwise not have been aware of. That should 
be seen as an important outcome of the training: 
making sure that institutions go in with eyes wide 
open and aware of the task ahead of them. Knowing 
the complexities involved in program design and 
development—not to mention implementation—can 
help institutions be aware of the kind of time and 
resources that are needed, as well as the impor- 
tance of involving other institutional players like 
the registrar and financial aid officials. 

None of the views on CBE shared by the trainees 
were very surprising. In fact, they reflect the very 
specific content areas covered in the training. The 
trainees learned what was good about CBE and also 
what was challenging or unknown. Thus informed, 
they were able to move forward—or not—based 
on other institutional factors: enthusiasm from a 
core group, support from the administration, and 
perhaps momentum buoyed by a positive training 
experience. 
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Pre- and post-tests were used to capture the 
immediate reaction of the 463 trainees. They were 
asked to rate on a five-point scale the extent to 
which they agreed or disagreed with a series of 
statements about CBE. These statements were 
crafted to address the trainings three objectives 
to improve CBE knowledge, understanding of CBE’s 
value, and personal opinions about CBE. 

The expectation was for trainees to indicate that 
their views about these statements had changed 
between the start and the end of the training—a 
“good” change was one in which the trainee saw 
improvements in CBE knowledge, increased under- 
standing of the value of CBE, and more positive 
opinions about CBE. For example, a good change is 
one in which a participant would respond to the state- 
ment “I can define competency-based education” 
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APPENDIX. PRE- AND POST-TESTS OF 
JUMPSTART TRAINEES 


with a 4-Somewhat Disagree on the pre-test and a 
2-Somewhat Agree on the post-test. A good change 
can also go in the opposite direction, for example: 
in response to the statement, “I am anxious about 
what CBE means for the future of higher education,” 
a good change would be moving from 1-Agree on the 
pre-test to 3-Neutral on the post-test. 

Overall, the greatest change from pre- to post- 
test was in the area of general knowledge about 
CBE—the greatest proportion of participants moved 
along the scale from the disagree to the agree side 
on general CBE knowledge than for any other topic. 
There were many trainees who also saw “good 
change” in their views of the value of CBE and their 
personal opinions about CBE, but the ratings suggest 
that the impact of the training in these areas was 
not as widespread. 


AWA A ots (1 0X0) 1 


Table 1. Average survey scores for all participants 


Pre Post Difference % "Good" Change 


| can define competency-based education (CBE). 2.02 1.26 0.76 57.2% 
| believe CBE is a valid pedagogical method. 1.71 1.43 0.28 32.9% 
| am interested in being part of a CBE program at 1.57 1.49 0.08 19.8% 
my institution. 

CBE programs can improve perceptions about the 2.07 1.90 0.16 33.6% 
quality of a college degree. 

| can name three methods of competency-based 3.06 1.70 1.35 70.5% 
assessment. 

| believe a CBE program will make my job harder. 3.14 2.62 -0.52 19.8% 
| believe CBE can work for certain students. 1.69 1.36 0.33 31.3% 
| would recommend CBE programs to students. 1.93 1.76 0.18 32.7% 
| am anxious about what CBE and CBA mean for the 2.60 2.41 -0.19 27.4% 
future of education. 

| understand the need to consider a CBE program at 1.58 1.51 0.07 24.2% 
my institution. 

We already do competency-based assessment; we 2.51 2.04 0.46 49.5% 
don’t necessarily call it that. 

| am familiar with the differences among types of 3.14 1.55 1.59 80.5% 
CBE programs. 

| understand the relationship between learning 2.18 1.44 0.74 52.0% 
outcomes and competencies. 

| am interested in learning more about CBE 1.37 1.45 0.08 16.1% 
programs. 

| believe a CBE model can reduce the cost of a 1.92 1.76 0.16 33.6% 
college education. 

| understand the connection between prior learning 1.99 1.32 -0.67 50.7% 
assessment and CBE. 

| think CBE can be helpful for higher education to 1.71 1.36 0.35 35.3% 
create stronger connections with employers. 

This workshop gave me new information about CBE 1.14 

programs. 

This workshop answered most of my questions 1.65 

about CBE programs. 

The facilitator had good command of the content. 1.13 

The facilitator presented the information in a way 1.16 


that was easy to understand. 


| learned a lot in this workshop. 1.29 


*Negatively stated questions reverse scored for “Difference.” All negative differences signify “bad” 
change in score. 
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to increase access to education and economic 
security. We provide adults with career guidance 
and help them earn college credit for what they 
already know. We equip colleges and universities to 
attract, retain, and graduate more adult students. 
We provide employers with smart strategies for 
employee development. We build workforce 
organizations’ capacity to connect worker skills to 
employer demands. 
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